Continuous or discrete attractors in neural circuits? A self-organized switch at 

maximal entropy 



O 

o 

(N 

CD 
00 



Alberto Bernacchia 
Universita' "La Sapienza", Dipartimento di Fisica "E.Fermi", Roma 
(Dated: February 1, 2008) 

A recent experiment suggests that neural circuits may alternatively implement continuous or 
discrete attractors, depending on the training set up. In recurrent neural network models, continuous 
and discrete attractors are separately modeled by distinct forms of synaptic prescriptions (learning 
rules). Here, we report a solvable network model, endowed with Hebbian synaptic plasticity, which 
is able to learn either discrete or continuous attractors, depending on the frequency of presentation 
of stimuli and on the structure of sensory coding. A continuous attractor is learned when experience 
matches sensory coding, i.e. when the distribution of experienced stimuli matches the distribution 
of preferred stimuli of neurons. In that case, there is no processing of sensory information and neural 
activity displays maximal entropy. If experience goes beyond sensory coding, processing is initiated 
and the continuous attractor is destabilized into a set of discrete attractors. 
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Recurrent neural network models display persistent ac- 
tivity, i.e. stable attractor states, selective for the in- 
put stimuh ([H,[3,[l)). Discrete attractors are naturally 
generated by Hebbian plasticity ([3|)) storing the correla- 
tions in the input, and have been widely used in modeling 
neural representations of learned objects. Continuous at- 
tractors, on the other hand, model neural representations 
of continuous variables, such as retinal angle of visual 
stimuli ([1|), eye position (Q), or space coordinates (Q)- 
In order to build a continuous attractor, i.e. a subspace 
of marginally stable neural patterns, either homeostatic 
synaptic mechanisms are introduced (H, @), or fine tun- 
ing of parameters is required {^^, [HI])- 

Recently, a series of experiments revealed that expo- 
sure of subjects to stimuli from a morphing sequence is 
able to generate, in the recorded neural activity, discrete 
attractors as well as continuous ones ( i [iSl > [3 ) ■ I'^ 
particular, in both [l^] and activity of hyppocampal 
cells of rats is recorded while they move into boxes of mor- 
phing shapes. Varying the box shape, the former exper- 
iment revealed a sharp modulation (two discrete attrac- 
tors) of neural activity, while the latter showed a gradual 
variation (a continuous attractor). Moreover, the well 
known continuous coding of space, given by the place 
fields of hyppocainpal cells (|15i]), lays upon a discrete 
coding of shapes ([l3|). Hence, discrete and continuous 
attractors coexist in the same neural module, and this 
raises the question of whether selection of the attractor 
type depend only on the training setup, and whether the 
same network can generate both, via the same synaptic 
plasticity mechanism. 

In this letter, we present a binary neural network 
model, subject to Hebbian plasticity dynamics, which can 
be solved analytically (a similar model has been recently 
published in [la])- Previous solvable binary models con- 
sider plasticity as exclusively driven by the input stream, 
and treat recurrent neural dynamics only after learning. 
In our model, instead, the recurrent dynamics plays an 
active role in plasticity, giving rise to a surprisingly rich 



phenomenology. For rather typical choices of the form of 
the input tuning curve ([131)) network autonomously 
develops either continuous or discrete attractors, depend- 
ing on the frequency of occurrence of stimuli. If the 
distribution of presented stimuli equals the distribution 
of preferred stimuli of neurons, the emergent attractor 
is continuous. This corresponds to the case in which 
the occurrence of stimuli matches what is expected from 
sensory coding, there is no processing of sensory infor- 
mation, and neuronal activity displays maximal entropy. 
Conversely, if subsets of stimuli are presented more fre- 
quently, a discrete attractor appear for each highlighted 
set. 

The model network consists of binary neurons. Si = 
±1, and binary synapses, Jy = ±1 — l,...,iV). 
The efficacy of a synapse connecting neurons j to i fol- 
lows a stochastic Hebb's plasticity rule ([3): if neurons 
i and j are in correlated states (Si — Sj) and Jij = — 1, 
then Jij ^ with probability p. If the neurons are 



in anti-correlated states {Si 



-1 with probability p. 



—Sj) and Jij = +1, then 
Other configurations are 



unchanged. Mean-field dynamics, describing how the 
synaptic efficacies vary on average (denoted by angular 
brakets), is given by 
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dt 



-{j.,,{t)) + S.{t)S,{t) (1) 



Synapses store the memory of past correlations in neural 
activity, up to a timescale p^^, and regulate the recurrent 
currents received by neurons. The recurrent input to 
neuron i is equal to ((isij) 



1 ^ 



(2) 



Beside the recurrent current, representing the "memory 
trace" , each neuron i receives an external sensory signal. 
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determined by its "preferred stimulus" ry^. The exter- 
nal current to neuron z, upon presentation of stimulus 
a, is defined by the "tuning curve" E{rii — a), describ- 
ing how the external current is modulated by changes 
in the presented stimulus. We assume that the tuning 
curve is monotonically increasing {E' > 0) and centered 
{E{0) — 0), and we define the space of stimuli as the 
unitary segment, T = (— ^,+^) (?7i,Q; G T). However, 
results can be generalized to a decreasing as well as to a 
periodic tuning curve (to be presented elsewhere). The 
preferred stimulus r]i is randomly assigned to each neu- 
ron, following a distribution uj{r]). 

The total current afferent to each neuron is the sum 
of the recurrent and the external currents, and neural 
activity is -1-1 or —1, respectively, if the total current is 
above or below threshold (set to zero), i.e. ([l|, [1]) 



S.,{t + dt) = sign R,{t) + E{r], - a) 



(3) 



We present a theoretical analysis of the network dynam- 
ics, in the limit of an infinite number of neurons, and 
then we show computer simulations to corroborate the 
emerging picture. 

It turns out that the dynamics of neural activity can 
be described by a label /i(t) e T, such that 



S,it) = sig: 



(4) 



Hence, a single number /i, at each time step, defines the 
entire neural activity pattern. Eq.(|3]) holds trivially if 
the recurrent currents are negligible with respect to the 
external currents, and the activity label is just equal to 
the presented stimulus, fj, = a. However, a self-consistent 
argument demonstrates that, under quite general condi- 
tions, Eq.(l4|) holds, for some fi, even for large recurrent 
currents, after the synapses have "learned" the space of 
stimuli T. We know, from Eq.([T|), that the average synap- 
tic matrix {Jij) is a linear functional of the activity prod- 
uct Si{t)Sj(t). Then, since neural activities are mapped 
onto the space of stimuli (/i e T in Eq.Q), the synaptic 
matrix can be written as 



{Ji]{t)) = / ?A(m,*) sign(77, 

JT 



/i) sign(77j - n) dfi (5) 



where 'ip{pL,t) is the "distribution of stored patterns", 
expressing the relative weight of different patterns, la- 
beled by /i, in the synaptic memory matrix. It is positive 
{ip{^,t) > 0) and normalized {Jrpip{fi,t)dii — 1). In the 
following, we study the stationary behaviour of fi and 
ip, describing respectively the neural and synaptic states, 
and we discuss their physical interpretations. 

We assume that the dynamics of neurons is much faster 
than that of synapses, which are essentially frozen on the 
neural timescale. Upon presentation of a given stimu- 
lus a, neural activity reaches immediately a stationary 



state fXs^ resulting from the competition of external and 
recurrent currents. Then, synaptic learning applies over 
the state /is , until a new stimulus is presented and a new 
state fig is reached. By using Eqs.Q,®,®,® with 
li{t + dt) = ^it) — /is, and averaging over preferred stim- 
uli, the equation for /is is found. 



E{^s — a) + '^{fJ's) — ^ifJ-s) = const 



(6) 



where and fl are the cumulative distribution functions 
of, respectively, the density distributions of the stored 
patterns ip and of the preferred stimuli lo (an exam- 
ple is given in FiglT]), i.e. ^'(/i) = /_^-^^2 V''(m')'^m'5 ^'^'^ 

n{ri)= J2y^u{r]')dj]', and const = J^i'^-^) d(*+f^)/2 
(since synapses are frozen, the time dependence of 'ip 
is omitted). The stationary state fj,s is stable when 
E'{fis - a) + ipifJ-s) - w(Ms) > 0. 

The neural dynamics is a trade-off between the exter- 
nal drive and the recurrent dynamics. In order to get a 
physical intuition of Eq.®, we consider separately the 
recurrent and external contributions: the general solu- 
tion will be somewhere in between the two cases. If the 
external input is strong, Eq.® reduces to ii'(/is — a) = 0, 
whose solution is /is — ol. In that case, the strong input 
forces the neural pattern to match the stimulus. On the 
other hand, when the recurrent contribution dominates, 
Eq.® becomes ^'(/Xs) — 51 (/is) = const. The solutions of 
this equation are the attractors of the recurrent neural 
dynamics, in absence of the stimulus. If the distribution 
of stored patterns matches the distribution of preferred 
stimuli, i.e. if 5" = f2 everywhere, then const = 0, and 
all values of /is G T are solutions, all marginally stable: 
this corresponds to a continuous attractor. In general, 
if 4" 7^ 17, discrete attractors emerge. An illustrative ex- 
ample is given in FigUl where const is neglected: two 
discrete attractors appear near the maxima oiip. A con- 
tinuous attactor would appear when the two curves su- 
perimpose, intersecating at all points. 

The slow dynamics of ip depend on the sequence of 
input stimuli a, through the sequence of the resulting 
stationary neural patterns /is- We assume that each pre- 
sentation of a stimulus a is drawn independently from a 
distribution (/>(«). Starting from the synaptic mean- field 
dynamics, Eq.ljT]), using Eqs.Q,® and averaging over 
the presented stimuli, the dynamics of ip is written as 



dt 



ip{^,t)+ / <j){a)6{fi- ^s)da (7) 



where S is the Dirac pulse function, and /ts depends, via 
Eq.®, on the stimulus a and on the distribution ip it- 
self. Eq.Q implies that, from stimulus to stimulus, ip 
strenghtens the memory of each activated pattern of neu- 
ral activity /is, and slightly weakens all the others. The 
external-recurrent trade-off play a crucial role in deter- 
mining the stationary solution V's(/^) of Eq.©: when 
external currents dominate, /is = a, and the stationary 
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FIG. 1: An example of distribution of stored patterns and 
of preferred stimuli, the density (top, respectively tp and oj), 
and the cumulative distribution functions (bottom, and 57). 
The three intersections of 'I' and f2 (red circles) give approx- 
imately the stationary states of recurrent neural dynamics, 
one unstable (middle) and two stable (left and right). 



if £"(0) >Max(u;(/x)) , i.e. is favored by a strong exter- 
nal input and a homogeneous distribution of preferred 
stimuli. 

li (/) ^ uj, only discrete attractors stabilize, and we can 
calculate the stationary solution ips only at those points. 
However, we expect Eq.dH) to be a good approximation 
in the vicinity of a continuous attractor ((^ ~ w), if it is 
stable and positive {E'{0) > (f>,uj). In that case, patterns 
are stored more efRciently if the corresponding stimuli 
are more experienced and less preferred by neurons (large 
(j) and small uj). If the external input is weak (£"(0) < 
(f>{fj-)), the solution ([5]) is unstable: a continuous attractor 
is prohibited, while discrete attractors are still allowed, 
whose ipsifJ') diverges. In that case, synaptic changes are 
driven by the recurrent synaptic structure itself, rather 
than by the external signal, and we expect that the initial 
synaptic structure strongly affects the dynamics. 

In order to check to what extent the network processes 
sensorial information, we calculate the entropy of the 
distribution of the total neural activity, ^ — 
which is a continuous variable in the limit of large N, 
and whose distribution is denoted by p{A). In station- 
ary conditions, using Eq.([4]) and averaging over preferred 
stimuli, the entropy is calculated as 



solution simply replicates the distribution of presented 
stimuli, i.e. ips = 0- In that case, the synapses store 
exactly the presented input patterns, weighted by their 
relative frequency of appearance. Then, a continuous 
attractor (ip = lo) forms if the distribution of presented 
stimuli equals the distribution of preferred stimuli of neu- 
rons, i.e. if = Surprisingly, a continuous attractor 
stabilizes even if recurrent currents give a finite contri- 
bution, as demonstrated in the following. 

In general, a stationary solution of Eq.© is difficult 
to find. Neverthless, we can calculate self-consistently 
^JsifJ-) for stored patterns /z which correspond to station- 
ary states of the recurrent neural dynamics, i.e. those 
satisfyng '^s{^J■) — = const. The solution is 



H =- 



ipsip) = (pin) 



E'iO) - (/.(/i) 



(8) 



if positive, zero otherwise. This solution is stable if 
E' (0) > (pifJ.) ■ The contribution of the recurrent dynam- 
ics to plasticity is given by the term in square brakets, 
which disappears in the limit of large external input 
{E'{0) +oo), for which we recover tps — (p. 

We stress that the solution ^ is not valid for all values 
of /z, but only at the fixed points of ^'^(/x) — 57(/i) = const. 
However, \i (p = uj the solution of Eq.(l8]) is V's — ^, 
that corresponds to a continuous attractor, for which 
all points are fixed, and the solution ([8]) is valid every- 
where. Hence, if the distribution of presented stimuli 
equals the distribution of preferred stimuli of neurons, 
a continuous attractor may stabilize, as a result of the 
combined synaptic and neural dynamics. The continu- 
ous attractor, in terms of plasticity dynamics, is stable 



piA) log p{A)dA 



log{§)d^ (9) 



which is negative, and corresponds to (minus) the infor- 
mation gained when using a code based on the distribu- 
tion ^E* rather than on CI (if 5* is the true distribution). 
If the two distributions are equal, the network is in a 
continuous attractor state, and the entropy of neural ac- 
tivity is maximal (zero, and A is uniformly distributed, 
p — 1). Conversely, if '5 is different from il, the informa- 
tion inside neural activity equals the information gained 
by using the synaptic matrix, structured by learning, in- 
stead of sensory coding. Once normalized, Eq.([5]) is taken 
as an approximation of the stationary solution ips , whose 
cumulative ^'s is used for computing the theoretical en- 
tropy of Eq. dH). 

We illustrate our predictions by 100 computer simula- 
tions of the dynamics of the network (Eqs.(IT]),(l2|) and 
([3])), which is composed of 1000 neurons. For each 
simulation, synapses and neurons arc initialized at ran- 
dom, and distribution functions of preferred (uj) and 
presented {(p) stimuli are chosen randomly from the 
set of fourier series truncated at wave number 5 (i.e. 
1 + [^i ^i^(^) + where a^, bi are random 

in the interval (—0.5,0.5), and only positive series are 
taken). Then, 1000 preferred stimuli are drawn from w, 
for the 1000 neurons, and 2000 stimuli, to be presented, 
are drawn from (p. The tuning curve is linear, and its an- 
gular coefficient E' is chosen, for each simulation, from 
a uniform distribution (in the interval (0, 5)), to which is 
added the maximum of (p and uj (then ([S]) is stable and 
positive). Each stimulus is presented for 20 time steps. 
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FIG. 2: Entropy of neural activity, measured in simulations, 
plotted against the theoretical prediction. Each point is one 
of the 100 simulations of the network dynamics. 

and the learning timescale is set p = 10^^. In order to 
analise stationary conditions, neural activity is recorded 
only after presentation of the first 1000 stimuli, and en- 
tropy is evaluated by the neural activity (sampled in 50 
bins) at the last step of each of the remaining stimuli, 
from 1001 to 2000. 

Theoretical predictions are in good agreement with the 
simulation results, as shown in Fig[21 where the mea- 
sured entropy of neural activity is plotted against the 
prediction of Eq.®, each point is one simulation. The 
agreement is especially good for large entropies, where 
the network is close to a continuous attractor state, and 
for which Eq. ([5]) is a better approximation. The observed 
contribution of recurrent dynamics to plasticity is an av- 



erage 65% decrease in the entropy, with respect to the 
case of large external drive, separately studied. 

In summary, we have shown that a simple plastic net- 
work can generate both discrete and continuous attractor 
states, depending on the statistics of experienced stimuli 
and the structure of sensory coding. The network pro- 
vides a candidate explanation for the apparent discrep- 
ancy between the two experiments (l3| and , in which 
similar experimental conditions result in the observation 
of the two different types of attractors. Here, the contin- 
uous attractor has been shown to be more stable when 
the distribution of preferred stimuli is homogeneuos, such 
as commonly observed in the brain. We leave for a future 
work the study of the network finite-size effects, eventu- 
ally wasting a perfect continuous attractor state. From 
the computational point of view, the network introduces 
a novel functionality: the network divides stimuli in clus- 
ters (discrete attractors) when subsets of stimuli occur 
more frequently than what is expected from sensory cod- 
ing. In that case, neural activity expresses exactly the 
information gained by the learned synaptic matrix. If 
the statistics of presented and preferred stimuli match, 
neural activity displays maximal entropy (no additional 
information), and the network abandons any tentative 
to recognize clusters of stimuli, but it still provides their 
representation via the continuous attractor. The present 
network represents an effort to bridge high-level (mem- 
ory) areas of the brain, which could be modeled by recur- 
rent associative networks (Q), and early sensory brain 
areas, in which continuously var ying stimuli are repre- 
sented by smooth tuning curves ([IJ). Here, the recur- 
rent contribution to plasticity was found to decrease sub- 
stantially the entropy of neural activity. 
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